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Abstract 

Background: A mechanism that monitors the congruence between sensory inputs and motor outputs is necessary 
to control voluntary movement. The representation of limb position is constantly updated on the basis of 
somatosensory and visual information and efference copy from motor areas. However, the cortical mechanism 
underlying detection of limb position using somatosensory and visual information has not been elucidated. This 
study investigated the influence of visual feedback on information processing in somatosensory areas during 
movement execution using magnetoencephalography. We used an experimental condition in which the visual 
information was incongruent despite the motor execution and somatosensory feedback being congruent. Subjects 
performed self-paced bimanual movements of both thumbs, either symmetric or asymmetric, under normal visual 
and mirrored conditions. The mirror condition provided a visual feedback by showing a reflection of the subject's 
right hand in place of the left hand. Therefore, in the Asymmetric task of the Mirror condition, subjects saw 
symmetric movements despite performing asymmetric movements. 

Results: Activation in the primary somatosensory area (SI) revealed inhibition of neural activity and that in the 
secondary somatosensory area (Sll) showed enhancement with voluntary movement. In addition, the Sll 
contralateral to the side of stimulation was significantly enhanced in the Asymmetric task of the Mirror condition, 
which provided non-veridical visual feedback. 

Conclusions: These results suggested that visual information influenced the neuronal activity concerning 
sensorimotor interaction in the Sll during motor execution. The Sll contributes to the detection of unpredicted 
visual feedback of movement execution. 
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Background disrupts motor control. This situation typically produces 

The information for movement is provided by visual and relatively strong cognitive conflict such as the feeling 

somatosensory feedback and the integration of cross- that movement is not controlled by oneself, 

modal sensory processing and motor command is crit- Recently, an increasing number of studies have indicated 

ical for motor control. Efficient monitoring of body that cross-modal interaction occurred when neural activity 

movement depends on matching the predicted sensory from one sensory modality modulated activity in another 

consequences from internal motor commands with ac- [3-5]. Cross-modal links between visual and somatosensory 

tual sensory feedback [1,2]. Normally, visual estimates of information have shown the critical role of vision in deter- 

limb positions are congruent with somatosensory esti- mining limb position and localizing tactile sensations [6-9] . 

mates under normal visual conditions, but a mismatch For example, viewing a body part improves tactile percep- 

between watched and felt movements of the hand tion and facilitates the amplitude of long-latency compo- 
nents of event-related potentials [10-12]. In addition, there 
is evidence that vision of the body is crucial for localization 
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visual information changes the information processing in 
somatosensory areas. 

Although less attention has been devoted to the effect of 
observation of movement on information processing in 
somatosensory areas, some studies have reported neural 
modulation in the primary somatosensory area (SI) and 
secondary somatosensory area (SII). Previous studies 
showed that viewing another persons gestures modulates 
the excitability of somatosensory areas [15-18]. These 
results indicate that the somatosensory areas are involved 
in the mirroring of actions. In addition, our recent study 
showed that somatosensory areas have a functional role to 
detect a mismatch between the intended and actual visual 
feedback of voluntary movement [19]. However, we could 
not fully clarify the neural mechanism of cross -modal 
interaction between visual and somatosensory modalities 
during movement execution. We must look more carefully 
into the effect of visual feedback on somatosensory infor- 
mation processing because the mismatch was very different 
between the expected and actual visual information in pre- 
vious study. In the Mirror condition, which provided false 
visual information on movement, the actual visual feedback 
was a stationary hand and the intended feedback was an 
image of a moving thumb. To further address this issue, 
the present study investigated the neural modulation 
caused by the visual feedback that only differed in the 
phase of the moving hand. 

The aim of the present study was to elucidate sensori- 
motor mechanisms in detecting incongruence if visual 
feedback did not match with the predicted one based on 
somatosensory feedback and motor command. We ex- 
perimentally manipulated visual feedback using the mir- 
ror box technique [20-22]. We created non-intended 
visual feedback by showing a reflection of the subjects 
right hand in place of the left hand during movement 
execution. 

Methods 

Subjects 

Ten healthy volunteers participated in the study (10 males; 
mean age 35.2 ± 5.3 years, range 28-46 years). None had a 
history of neurological disorders or took medication before 
the experiment. All subjects were right-handed as assessed 
by the Edinburgh Handedness Inventory (average score, 
91.1) [23]. Written informed consent was obtained from 
each participant prior to the study, which was approved by 
the Ethics Committee at the National Institute for Physio- 
logical Sciences, Okazaki, Japan. 

Stimulation 

The left median nerve was stimulated on the palm side 
at the wrist with a saddle-type electrode. The electrode 
was fixed to the wrist using a belt to prevent it moving 
during movement execution. The cathode was placed 



3 cm proximal to the anode. The electrical stimulus was 
a constant current square-wave pulse 0.2 ms in duration 
and the stimulus intensity was 1.1 times the motor 
threshold of the abductor pollicis brevis muscle, which 
yielded no pain or unpleasant sensation. The interstimu- 
lus interval of electrical stimuli was 3000 ms. 

Experimental conditions 

In this study, we measured brain activities in somatosen- 
sory areas while subjects performed two bimanual move- 
ment tasks in two conditions (Figure 1). In the Mirror 
condition, subjects inserted their hands into a mirror 
box with the forearm supine. The position of the right 
hand was adjusted so that the mirror image precisely 
overlapped the view of the masked left hand. A mirror 
image of the right hand was therefore presented instead 
of the left hand. In the NoMirror condition, the mirror 
box was removed. For the magnetoencephalography 
(MEG) recordings, subjects were instructed to gaze at a 
small round mark (0.8 cm in diameter) approximately 
0.5 m away between the two hands. 

In each condition, three tasks were performed. Subjects 
were instructed to make simple, self-paced repetitive 
hand movements that involved extending and flexing 
both thumbs either symmetrically (Symmetric task) or 
asymmetrically (Asymmetric task). In both tasks, we 
asked the subjects to perform the sequence of movement 
(thumb flexion-extension) at a frequency of about 1 Hz. 
We asked that they did not synchronize their movements 
with the electrical stimulation. We monitored the thumb 
movement with a video camera from outside of a 
shielded room. If the pace of movement was slower or 
faster than 1 Hz, we gave instructions to the subject. The 
other task was that both hands were kept stationary (Sta- 
tionary task). In all tasks, subjects were instructed to pay 
no attention to the electrical stimulation. In the Mirror 
condition of the Asymmetric task, since the actual visual 
information on left hand movement was masked by the 
mirror, subjects saw symmetric movements despite per- 
forming asymmetric movements. In contrast, for the 
Symmetric task, although subjects saw the mirrored 
movement, the phase of bimanual movement was the 
same in masked and mirrored hands. One session of the 
three tasks comprised 50 stimuli and the recording time 
of one session was about 3 min. Two sessions were per- 
formed, and 100 artifact-free responses were averaged for 
each condition. The order of tasks in each condition was 
randomized among the subjects. 

Data acquisition and analysis 

The MEG signals were recorded with a helmet-shaped 
306-channel detector array (Vectorview, Elekta Neuromag 
Yo, Helsinki, Finland), which comprised 102 identical triple 
sensor elements. Each sensor element consisted of two 
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Figure 1 The experimental paradigm used in this study. Subjects performed self-paced bimanual movements, either symmetric (Symmetric 
task) or asymmetric (Asymmetric task), of both thumbs. The other task was that both hands were kept stationary (Stationary task). The three tasks 
were conducted with normal visual feedback (NoMirror condition) and non-veridical visual feedback (Mirror condition). In the Asymmetric task of 
the Mirror condition, since the actual visual information on left hand movement was masked by the mirror, subjects saw symmetric movements 
despite performing asymmetric movements. By contrast, in the Symmetric task, although subjects saw the mirrored movement, the phase of 
bimanual movement was the same for masked and mirrored hands. Electrical stimulation for the recording of somatosensory responses was 
delivered to the median nerve at the left wrist. 



orthogonal planar gradiometers and one magnetometer 
coupled to a multi-superconducting quantum interference 
device and thus provided three independent measurements 
of the magnetic fields. The MEG signals were recorded 
with a bandpass filter of 0.03-300 Hz and digitized at 
1024 Hz. Epochs in which the signal variation was larger 
than 3000 fT/cm were excluded from the averaging. The 
period of analysis was from 100 ms before to 250 ms after 
the onset of the electrical stimulus. The data for 100 ms 
before the stimulus were used to calculate the baseline. 

Prior to the MEG recording, four head position indica- 
tor (HPI) coils were placed at specific sites on the scalp. 
To determine the exact location of the head with re- 
spect to the MEG sensors, an electric current was fed 
to the HPI coils, and the resulting magnetic fields 
were measured with the MEG sensors. These proce- 
dures allowed for alignment of the individual head co- 
ordinate system with the MEG coordinate system. The 
locations of HPI coils with respect to the three ana- 
tomical landmarks (nasion and bilateral preauriculas) 
were also measured using a three-dimensional digitizer 
to align the coordinate systems of MEG with the Tl- 
weighted magnetic resonance images (MRI) obtained 
with a 3 tesla MRI system (Allegra; Siemens, Erlangen, 
Germany). The x-axis was fixed with the preauricular 



points, the positive direction being to the right. The posi- 
tive y-axis passed through the nasion and the z-axis thus 
pointed upward. 

We first calculated vector sums from the longitudinal 
and latitudinal derivatives of responses recorded on the 
planar-type gradiometers at each of the 102 sensors' 
locations (Figure 2). This was achieved by squaring 
MEG signals for each of two planar-type gradiometers at 
a sensors location, summing the squared signals to- 
gether, and then calculating the root of the sum, here we 
call this the "root sum square" (RSS) [24]. The calcula- 
tion was carried out for all 102 sensors' locations. Next, 
we used the RSS waveforms and a topographic map of 
RSS amplitude to look for a peak channel showing the 
greatest amplitude for each prominent response, because 
the waveforms had several responses with a different 
spatial distribution of amplitude. Then, the peak ampli- 
tude and latency of prominent responses in the RSS 
waveform were measured at the peak channel. 

To identify the equivalent current dipoles (ECDs) in 
MEG components, sources of measured responses to 
the electrical stimuli were modeled with the time- 
varying current dipoles method [25]. Single ECDs of 
MEG components were estimated. In the period when 
clear dipolar magnetic field patterns were found, the 
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Figure 2 Method of analysis used in this study. (A) The MEG waveforms viewed from the top of the head following stimulation of the left 
median nerve recorded from 204 sensors in the Stationary task. Clear deflections were obtained in the central region contralateral to the side 
stimulated and in the temporal regions in both hemispheres. (B) The RSS waveforms from 102 sensors in the stationary task. (C) Enlarged MEG 
and RSS waveforms of the primary somatosensory area (SI), the secondary somatosensory cortex contralateral (SI Ic) and ipsilateral to the side 
stimulated (SIN), and the parietal cortex (PC). A vertical line indicates the onset of stimulus. 



ECDs that best explained the most dominant signals 
were determined by a least-squares search, based on 14 
to 18 channels around the channel that had been used 
to measure the peak amplitude of RSS waveforms. The 
goodness-of-fit (GOF) value of an ECD was calculated 
to indicate in percentage terms how much the dipole 
accounted for the measured field variance. Only ECDs 
which accounted for more than 80% of the GOF in a 
channel subset were accepted. 

For the peak amplitude of the RSS components, to 
examine whether visual feedback affects the activation of 
somatosensory areas during bimanual movement, a two- 
way repeated measures ANOVA was performed with 
visual condition (Mirror and NoMirror conditions) and 
movement task (Symmetric, Asymmetric and Stationary 
tasks) as the factors. To analyze the assumption of 
sphericity prior to the repeated measures ANOVA, we 
used Mauchly s test of sphericity. If a significant test re- 
sult was obtained and the assumption of sphericity was 
violated, the Greenhouse-Geisser adjustment was used 
to correct for the sphericity by altering the degrees of 
freedom using a correction coefficient epsilon. A post- 
hoc analysis was conducted using paired t-test. Statistical 
significance was set at a P value of less than 0.05. 

Results 

Figure 2 shows the waveforms of somatosensory evoked 
fields (SEFs) and RSS in the stationary condition follow- 
ing stimulation of the left median nerve. Five prominent 
components were observed in RSS waveforms. The 



earliest deflection of the RSS waveforms was identified 
in the central region contralateral to the side stimulated 
at around 20 ms after the stimulation (M20) and the 
subsequent deflection peaking at around 35 ms (M35). 
Long-latency components were identified in temporal 
regions of both hemispheres at around 90 ms (M85 and 
M90). The ECD for the early responses was located in 
the posterior bank of the central sulcus corresponding 
to the SI. The bilateral long-latency responses were esti- 
mated to be generated in the upper bank of the sylvian 
fissure, corresponding to the SII (Figure 3). In addition, 
around the central region contralateral to the side of 
stimulation, the sensor was located more posterior than 
the SI, and a small peak was observed at about 95 ms 
(M95). The source of the M95 was estimated to be 
around the parietal cortex (PC) in the posterior wall of 
the postcentral sulcus. 

Grand-averaged RSS waveforms for each task of the 
two conditions are shown in Figure 3. To investigate 
the effect of visual feedback on neural activation in 
the somatosensory areas during movement execution, 
we compared the peak amplitude of RSS components 
using a two-way repeated ANOVA concerning task 
(Symmetric, Asymmetric and Stationary) and condition 
(Mirror and NoMirror). Figure 4 shows the peak amp- 
litude of RSS components. A significant main effect of 
task on the M20 and M35 in the SI was found 
(M20 F 1>9 = 7.875, P < 0.05 M35 F 1>9 = 16.093, P < 0.01), 
but no significant main effect of condition or inter- 
action. The amplitude of SI components exhibited a 
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Figure 3 The grand averaged RSS waveforms and dipole locations. (A) The grand averaged RSS waveforms in each task of the two 
conditions in the SI, Sllc, Slli, and PC A vertical line indicates the onset of stimulus. Prominent responses were observed at around 20 ms (M20) 
and 35 ms (M35) in the SI, around 85 ms (M85) and 150 ms (M150 Sllc) in the Sll contralateral to the side of stimulation, around 90 ms (M90) and 
150 ms (M150 Slli) in the Sll ipsilateral to the side stimulated and around 95 ms (M95) in the PC. A reduction in SI components and an 
enhancement of Sll components were identified with movement execution. In addition, the M85 showed significant enhancement in the 
Asymmetric task of the Mirror condition. (B) The location of equivalent current dipoles (ECDs) in each component superimposed on the T1- 
weighted magnetic resonance images. The ECD for short-latency responses was located in the posterior bank of the central sulcus (SI) in the 
hemisphere contralateral to the side stimulated, and the long-latency responses (M85 and M90) were identified in the bilateral temporal regions 
around the upper bank of the sylvian fissure, corresponding to the Sll. The source of the parietal activity (M95) was located medial and posterior 
to the SI hand area in the hemisphere contralateral to the side stimulated. 
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Figure 4 The modulation of RSS components with voluntary movement in the Mirror and NoMirror conditions. The y-axis indicates the 
peak amplitude of RSS component and the error bar means the standard deviation. A two-way repeated measures ANOVA was performed with 
visual condition (Mirror and NoMirror conditions) and movement task (Symmetric, Asymmetric and Stationary tasks) as the factors. A significant 
main effect of task was found in the M20 and M35 of the SI. In addition, a significant interaction was found in the M85 of Sllc and M95 of PC. 
The amplitude of the M85 in the Asymmetric task was significantly larger in the Mirror condition than NoMirror condition. In contrast, no 
difference was observed in the Symmetric task. *P < 0.05, between two conditions. 



reduction during movement execution. In the SII 
contralateral to the side of stimulation (Sllc) and PC 
components, although no significant main effect was 
observed, a significant interaction was found in the M85 
(F 2)18 = 6.425, P < 0.05) and M95 (F 2>18 = 3.731, P < 0.05). 
In contrast, no significant change was observed in the 
M90 and M150 in the SII ipsilateral to the side of 



stimulation (Slli) and the M150 in the Sllc. We com- 
pared the Sllc component in each task between the Mir- 
ror and NoMirror conditions. In the Asymmetric task, 
the amplitude of the Sllc was significantly higher in the 
Mirror than NoMirror condition (P < 0.05), while no 
significant change was observed in the Stationary and 
Symmetric tasks between the two visual conditions. 
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The non-veridical visual feedback in the Asymmetric task 
of the Mirror condition affected the activation of the SIIc 

Discussion 

We investigated whether activation in somatosensory 
areas was affected by the discordance of visual infor- 
mation between intended and executed actions. Sub- 
jects received visual feedback about thumb movement 
that was unintended in the Asymmetric task of the 
Mirror condition or expected in the Symmetric task of 
the Mirror condition and NoMirror condition. In the 
conflict caused by the unintended visual feedback, acti- 
vation in the SIIc was significantly higher in the Mir- 
ror condition than NoMirror condition. The results of 
this study are in line with our previous findings show- 
ing cross-modal interaction between somatosensory 
and visual modalities in the SII when looking at unin- 
tended visual information on a moving hand provided 
during movement execution [19]. 

Viewing the body influences the speed of tactile reac- 
tion time [26] and improves tactile acuity [27]. Longo 
et al. [28] reported that the short-latency component of 
somatosensory evoked potentials (SEPs) generated in the 
SI was higher on viewing the body than viewing an ob- 
ject. Furthermore, in addition to viewing the body, the 
observation of moving body parts also modulates the SI 
activation [15-18], whereas our results showed no 
changes of SI activity on viewing the unintended visual 
feedback of body movement. It is well-known that the 
neural activity in the SI is strongly inhibited during vol- 
untary movement [29-34]. One explanation for the ab- 
sence of modulation of SI activity with the unexpected 
visual information in our study may be that the inhibi- 
tory effect from motor-related areas canceled out the ef- 
fect from visual information. 

We found that the SIIc response in the Asymmetric 
task was significantly higher in the Mirror condition 
than NoMirror condition, while no change was observed 
in the Symmetric task. The Asymmetric task in both 
conditions was similar with regard to motor command 
and somatosensory feedback, and the only difference 
was the visual feedback. There was a possibility that a 
very subtle twitch following the stimulation caused the 
difference in visual feedback between the Mirror and 
NoMirror conditions. However, since the stimulus inten- 
sity was just above the motor threshold, the extension- 
flexion of the thumb was much larger than the small 
twitch during movement tasks. It seems reasonable to 
eliminate the notion that the difference in visual feed- 
back caused by a minor twitch induces the enhancement 
in the SIIc. 

The neural mechanism responsible for modulation of 
SIIc activities through non-veridical visual feedback is 
unclear. One possibility is that the incongruent visual 



information enhances the SIIc activation via an atten- 
tional effect. The SII is involved in cross-modal atten- 
tional links between the somatosensory and visual 
modalities [3], and the sight of body parts influences 
somatosensory event-related potentials with tactile 
spatial attention [14]. A probable explanation for the 
modulated neural activations in the SIIc observed in the 
Mirror condition might be that the visual feedback of 
unintended phase movement caused by replacement of 
the subjects' left hand with a mirror image of the right 
hand implicitly led to increased attentional demands for 
the somatosensory information. Another possibility is 
that the neural mechanism providing the visual informa- 
tion on the body part would be influenced by predictions 
of visual feedback based on the motor commands. It has 
been suggested that a copy of the motor signal, known 
as an efference copy, is created so that sensory signals 
generated from external stimuli can be distinguished 
from reafferent signals from body movement [2,35,36]. 
Corollary discharges are produced only if the motor 
commands interact with unpredicted sensory inputs and 
inhibits the neural response to the self-generated sensory 
signals [37]. More activity in somatosensory areas was 
found when the unpredicted stimulus was externally 
delivered [38-40]. There is considerable validity to no- 
tion that the prediction of visual feedback modulates the 
somatosensory areas. In the Asymmetric task in the Mir- 
ror condition, subjects faced the surprise of seeing that 
their hand was not responding as intended, and activa- 
tion in the SIIc might be modulated by the effect of cor- 
ollary discharge. 

We assume that this modulation in the SIIc is involved 
in computing the sensory errors by comparing the actual 
hands location to the estimated location for controlling 
movement. There is another cortical area that is import- 
ant to a forward model [2]. The cerebellum builds in- 
ternal models that predict the sensory feedback of motor 
commands and correct motor commands through in- 
ternal feedback. The cerebellum also has been proposed 
to combine information from motor efferent and sensory 
afferent signals [41]. However, we could not record any 
cerebellar responses because our whole-head MEG sys- 
tem did not fully cover the cerebellum. 

There is evidence that humans are normally not con- 
scious of sensory feedback from movement [42], and are 
aware that their arms and legs belong to them through 
somatosensory and visual inputs. This feeling of self- 
attribution is impaired when the predicted sensory infor- 
mation estimated from motor intention does not match 
the actual sensory information. In our study, the Asym- 
metric task of the Mirror condition corresponded to this 
situation. Some subjects reported feeling that movement 
in the Asymmetric task of the Mirror condition was not 
controlled by themselves or the body did not belong to 
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them. Studies in patients and recent neuroimaging 
results in healthy subjects suggest a prominent role for 
the posterior parietal cortex [43] and insula [44-47] in 
the self-awareness of limb actions, the sense of agency. 
Inui et al. [48] reported simultaneous activation in the 
contralateral SII and insula peaking at 90 to 160 ms after 
electrical stimulation. We assumed that the late compo- 
nent peaking at 150 ms (Ml 50) in the SIIc may involve 
the SII activity of the neighboring insula. However, we 
could not find significant differences in the insula and 
PC. Although subjects reported a disturbance of agency, 
we assumed that it was not enough to induce the differ- 
ence in these areas. Further study will be needed to clar- 
ify the functional role of these areas in sensorimotor 
integration. 

Conclusions 

This study revealed the neural mechanism of somatosen- 
sory activation during visual conflict caused by incon- 
gruence between the predicted and actual visual 
feedback in motor control. Our results demonstrated 
that the SII had cross-modal functions in the somato- 
sensory and visual modalities during motor execution. 
However, we did not elucidate visuo-tactile interaction 
in other somatosensory areas such as the posterior par- 
ietal cortex and insula. Further research may be useful 
to elucidate the functional role of somatosensory areas 
for motor control using somatosensory and visual 
information. 
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